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(54) Cache memory access system and method 



(57) A digital system is provided with a several proc- 
essors, a private level one (L1) cache associated with 
each processor a shared level two (L2) cache having 
several segments per entry, and a level three (L3) phys- 
ical memory. The shared L2 cache architecture is em- 



bodied with 4-way associativity, four segments per entry 
and four valid and dirty bits. Multiple detection circuitry 
responds to several cache access requests concurrent- 
ly. Multiple ports in the cache service multiple requesters 
concurrently if concurrent hits are detemnined by the de- 
tection circuitry. 
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Description 

Technical Field ot the Invention 

5 [0001] This invention generally relates to microprocessors, and more specifically to improvements in cache memory 
access circuits, systems, and methods of making. 

Background to the Invention 

10 [0002] Microprocessors are general purpose processors which provide high instruction throughputs in order to ex- 
ecute software running thereon, and can have a wide range of processing requirements depending on the particular 
software applications involved. A cache architecture is often used to increase the speed of retrieving information from 
a main memory. A cache memory is a high speed memory that is situated between the processing core of a processing 
device and the main memory. The main memory is generally much larger than the cache, but also significantly slower. 

15 Each time the processing core requests information from the main memory, the cache controller checks the cache 
memory to determine whether the address being accessed is currently in the cache memory. If so, the information is 
retrieved from the faster cache memory instead of the slower main memory to service the request. If the information 
Is not in the cache, the main memory is accessed, and the cache memory is updated with the information. 
[0003] Many different types of processors are known, of which microprocessors are but one example. For example, 

20 Digital Signal Processors (DSPs) are widely used, in particular for specific applications, such as mobile processing 
applications. DSPs are typically configured to optimize the performance of the applications concerned and to achieve 
this they employ more specialized execution units and instruction sets. Particularly in applications such as mobile 
telecommunications, but not exclusively, it is desirable to provide ever increasing DSP performance while keeping 
power consumption as low as possible. 

25 [0004] To further improve performance of a digital system, two or more processors can be interconnected. For ex- 
ample, a DSP may be interconnected with a general purpose processor in a digital system. The DSP performs numeric 
intensive signal processing algorithms while the general purpose processor manages overall control flow. The two 
processors communicate and transfer data for signal processing via shared memory. A direct memory access (DMA) 
controller is often associated with a processor in order to take over the burden of transferring blocks of data from one 

30 memory or peripheral resource to another and to thereby Improve the performance of the processor. 

Summary of the Present Invention 

[0005] In accordance with a first embodiment of the invention, there is provided a method of operating a digital system 
35 that has a cache with a plurality of request ports. After receiving a set of requests on the request ports, they are 
evaluated to determine hit/miss status. Multiple hits are served concurrently via separate ports of the cache. 
[0006] In another embodiment, the cache is configured as two or more distinct portions. A request in each portion 
can be serviced concurrently. A set of requests are sorted into separate queues each associated with a different portion 
of the cache. 

40 [0007] In another embodiment, the requests in different queues are sorted according to a priority associated with 
each request in the queue. 

[0008] In another embodiment, the cache is configured as two or more distinct portions based on a range of addresses 
assigned to one portion. A request for an address that is assigned to this portion is blocked from other portions of the 
cache. A request in each portion can be serviced concurrently. 

45 [0009] In another embodiment, a digital system is provided with a cache that has a plurality of sets which each have 
a plurality of lines for holding data and an associated tag to indicate if data stored in each line is valid. One detection 
circuit is operable to detect if a first requested data Is present in the cache by examining one set of tags. Another 
detection circuit is operable to detect if a second requested data is present in the cache by examining a different set 
of tags. Both detection circuits operate concurrently. The cache is a level two cache, but in other embodiments the 

50 cache may be a first level or a higher level cache. 

[0010] In another embodiment, a first level cache embodying the present invention may make requests to a second 
level cache that also embodies the present invention. 

Brief Description of the Accompanying Drawings 

55 

[001 1] Particular embodiments in accordance with the invention will now be described, by way of example only and 
with reference to the accompanying drawings in whk:h: 
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Figure 1 is a block diagram of a digital system that includes an embodiment of the present invention in a megacell 
core having multiple processor cores ; 

Figure 2 A and 2B together is a more detailed block diagram of the megacell core of Figure 1 ; 
Figure 3A is a bk>ck diagram illustrating a configurable cache that is included in the megacell of Figure 1 that has 
5 a cache and a RAM-set; 

Figure 3B is a flow chart illustrating operation of the hit/miss logic of the configurable cache of Figure 3A; 
Figure 4 is a flow diagram for the level two (L2) cache in the megacell of Figure 1 illustrating an interruptible prefetch 
system that provides miss under miss support; 

Figure 5 is a flow chart illustrating operation of the interruptible prefetch system of Figure 4; 
10 Figure 6A is a timing diagram of the interruptible prefetch system illustrating a low priority prefetch being halted in 

favor of a higher priority miss; 

Figure 6B is a timing diagram of the interruptible prefetch system illustrating a higher priority prefetch not being 
hatted in favor of a lower priority miss; 

Figure 7 is a flow diagram for the L2 configurable cache that illustrates concurrent access of the L2 cache and L2 
15 RAM-set of the megacell of Figure 1 ; 

Figure 8A illustrates a request queue for the L2 memory system of Figure 3A 

Figure 8B is a more detailed block diagram of the L2 memory system of Figure 3A, illustrating the request queue; 
Figure 8C is a flow chart illustrating operation of simultaneous multiprocessor accesses to the L2 cache of Figure 
3A; 

20 Figure 9 is a block diagram illustrating a priority register in each processor of a megacell similar to that of Figure 

1 for task based priority arbitration; and 

Figure 1 0 is a representation of a telecommunications device incorporating an embodiment of the present invention. 

[0012] Corresponding numerals and symbols in the different figures and tables refer to corresponding parts unless 
25 othenwise indicated. 

Detailed Description of the Preferred Embodiments 

[0013] Although the invention finds particular application to Digital Signal Processors (DSPs), implemented, for ex- 
30 ample, in an Application Specific Integrated Circuit (ASIC), it also finds application to other forms of processors. An 
ASIC may contain one or more megacells which each include custom designed functional circuits combined with pre- 
designed functional circuits provided by a design library. 

[0014] Figure 1 is a block diagram of a digital system that includes an embodiment of the present invention in a 
megacell core 100 having multiple processor cores. In the interest of clarity, Figure 1 only shows those portions of 

35 megacell 100 that are relevant to an understanding of an embodiment of the present invention. Details of general 
construction for DSPs are well known, and may be found readily elsewhere. Forexample^ U.S. Patent 5,072,41 8 issued 
to Frederick Boutaud, et al.. describes a DSP in detail. U.S. Patent 5,329,471 issued to Gary Swoboda, et al, describes 
in detail how to test and emulate a DSP. Details of portions of megacell 100 relevant to an embodiment of the present 
Invention are explained in sufficient detail herein below, so as to enable one of ordinary skill in the microprocessor art 

-^o to make and use the invention. 

[0015] Referring again to Figure 1, megacell 100 includes a control processor (MPU) 102 with a 32 -bit core 103 and 
a digital signal processor (DSP) 104 with a DSP core 105 that share a block of memory 113 and a cache 114, that are 
referred to as a level two (L2) memory subsystem 112. A traffic control block 110 receives transfer requests from a 
memory access node in a host processor 120, requests from control processor 102, and transfer requests from a 
memory access node in DSP 1 04. The traffic control block Interleaves these requests and presents them to the shared 
memory and cache. Shared peripherals 116 are also accessed via the traffic control block. A direct memory access 
controller 106 can transfer data between an external source such as off -chip memory 132 or on-chip memory 134 and 
the shared memory. Various application specific processors or hardware accelerators 108 can also be included within 
the megacell as required for various applications and interact with the DSP and MPU via the traffic control block. 

so [0016] External to the megacell, a level three (L3) control block 1 30 is connected to receive memory requests from 
internal traffic control block 110 in response to explicit requests from the DSP or MPU, or from misses in shared cache 
114. Off chip external memory 132 and/or on-chip memory 134 is connected to system traffb controller 130; these are 
referred to as L3 memory subsystems. A frame buffer 1 36 and a display device 1 38 are connected to the system traffic 
controller to receive data for displaying graphical images. Host processor 120 interacts with the resources on the 

55 megacell via system traffic controller 130. A host interface connected to traffic controller 130 allows access by host 
120 to megacell 100 internal and external memories. A set of private peripherals 140 are connected to the DSP, while 
another set of private peripherals 142 are connected to the MPU. 

[0017] Figure 2 is a more detailed block diagram of the megacell core of Figure 1 . DSP 1 04 includes a local memory 
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200 and data cache 202, a configurable cache 204 that is configured as instruction cache 206 and a block of memory 
208, which are referred to as level one (L1 ) memory subsystems. The DSP is connected to the traffic controller via an 
L2 interface 21 0 that also includes a translation look-aside buffer (TLB) 21 2. A DMA circuit 21 4 is also included within 
the DSP Individual micro TLBs (\iTLB) 21 6-21 8 are associated with the DMA circuit, data cache and instruction cache. 
5 respectively 

[0018] Similarly, MPU 102 includes a local memory 220 and data cache 222, a configurable cache 224 that is con- 
figured as instruction cache 226 and a block of memory 228, again referred to as L1 memory subsystems. The MPU 
is connected to traffic controller 110 via an L2 interface 230 that also includes a TLB 232. A DMA circuit 234 is also 
included within the MPU. Individual micro TLBs (mTLB) 236-238 are associated with the DMA circuit, data cache and 
10 instruction cache ; respectively 

[001 9] L2 traffic controller 1 1 0 includes a TLB 240 and a micro-TLB (^TLB) 242 that is associated with system DMA 
block 106. Similarly, L3 traffic controller 130 includes a ^iTLBcontrollably connected to TLB 232 that is associated with 
system host 120. This ixTLB is likewise controlled by one of the megacel! 100 processors. 

^5 Memory Management Unit 

[0020] At the megacell traffic controller level, all addresses are physical. They have been translated from virtual to 
physical at the processor sub-system level by a memory management unit (MMU) associated with each core, such as 
DSP core 105 and MPU core 1 03. At the processor level, access permission, supplied through MMU page descriptors, 
20 Is also checked, while at the megacell level protection between processors is enforced by others means, which will be 

described in more detail later. 

[0021] The TLB caches contain entries for virtual-to-physicat address translation and access permission checking. 
If the TLB contains a translated entry for the virtual address, the access control logic determines whether the access 
Is permitted. If access is permitted, the MMU generates the appropriate physical address corresponding to the virtual 

25 address. If access is not perniitted, the MMU sends an abort signal via signal group 244 to MPU 102. 

[0022] Upon a TLB miss, i.e., the TLB does not contain an entry corresponding to the virtual address requested, 
translation table walk software retrieve^: tne translation and access permission information from a translation table in 
physical memory. Once retrieved, the page or section descriptor is stored Into the TLB at a selected victim location. 
Because a "load and store multiple" instruction may potentially cross a page boundary, the permission access is 

30 checked for each sequential address. 

[0023] Unpredictable behavior will occur if two TLB entries correspond to overlapping areas of memory in the virtual 
space. This can occur if the TLB is not flushed after the memory is re-mapped with different-sized pages leaving an 
old mapping with different sizes in the TLB, and making a new mapping that gets loaded into a different TLB location, 
for example. 

35 

Translation Table 

[0024] A translation table held in main memory has two levels: a first-level table holds both section translation entries 
and pointers to second-level tables (either fine tables or coarse tables); second-level tables hold both large, small and 

40 tiny page translations entries. The present embodiment has a distributed OS with several domains corresponding to 
each processor and therefore only a single table manager for all processors. Table update operations are limited to 
the corresponding R-ID for all slave processors. Access to all could be given to a super OS, such as a communication 
management OS. The super OS will have right to flush out entries belonging to another processor in a different OS 
domain. In another embodiment with several independent OS's, for example^ there will independent tables. These 

45 tables can be located in a memory space only viewed by the OS that they are associated with in order to provide 
protection from inadvertent modification by another OS. 

[0025] Translation tables and TLB cache contents must be kept consistent. A flush operation, which will be described 
later, is provided for this reason. 

[0026] An address reference is generally located within the nTLB or main TLB of each processor sub-system; how- 
5C ever, certain references, such as those used by system DMA 1 06 or host processor 120, for example, to access meg- 
acell memories can be distributed within L2 traffic controller 11 0 and cached into L2 system shared TLB 240. Because 
system performance is very sensitive to the TLB architecture and size, it is important to implement efficient TLB control 
commands to flush, lock or unlock an entry when a task is created or deleted without degrading the execution of other 
tasks. Therefore, each jiTLB and L2 cache entry holds a task-ID, also called ASID. During execution, the current task-JD 
55 register is compared with the jiTLB entry, this also provides better security, as will be described later. During MMU 
operation, commands are supplied to flush locked or unlocked entries of a |iTLB corresponding to a selected task. 
[0027] To provide maximum flexibility, the MMU is implemented as a software table walk, backed up by TLB caches 
both at the processor sub-system and megacell level. This allows easy addition of new page size support or new page 
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descriptor information if required. A TLB miss initiates an MMU handler routine to load the missing reference into the 
TLB. At the Megacell 100 level, a TLB miss asserts a miss signal in signal group 244 and is routed via system interrupt 
router 250 to the processor having generated the missing reference or to the processor in charge of the global memory 
management, via interrupt signals 251, 252. 

[0028] The MMU provides cacheability and bufferability attributes for all levels of memory. The MMU also provides 
a "Shared" bit for each entry to indicate that a page is shared among multiple processors (or tasks). This bit, as stan- 
dalone or combined with the task- ID, allows specific cache and TLB operation on data shared between processors or/ 
and tasks. 

[0029] All megacell memory accesses are protected by a TLB. As they all have different requirements in term of 
access frequencies and memory size, a shared TLB approach has been chosen to reduce the system cost at the 

megacell level. This shared TLB is programmable by each processor. The architecture provides enough flexibility to 
let the platfonm work with either an independent operating system (OS) or a distributed OS with a unified memory 
management^ for example. 

[0030] The present embodiment supports page size of IK, 4K, 64K and 1MB, but other embodiments might have 
TLB hardware/software supporting other page sizes. 

[0031] The organization of the data structures supporting the memory management descriptor is flexible since each 
TLB miss is resolved by a software TLB-miss handler. These data structures include the virtual -to- physical address 
translation and all additional descriptors to manage the memory hierarchy. In other embodiments, a processor may 
have other modes that enable access to memory without permission checks. 

Shared Cache and RAM 

[0032] Referring again to Figure 1 , Megacell 100 includes large shared memory subsystem 112 that function as a 
secondary level of RAM (L2 RAM) 113 and cache (L2 Cache) 114. This level of memory is preferably called the outer 
25 level, as each processor in various embodiments may have multilevel internal memory. However for the present em- 
bodiment, processors 102, 104 have one level of internal memory, which is referred to herein as LI within the memory 
hierarchy, therefore the outer level memory subsystem will be referred to as level two (L2). The megacell outer memory 
112 is organized as what's called a SmartCache, which is a configurable cache and which allows concurrent accesses 
on cache and RAM -set. RAM -set is a block of RAM that has aspects of cache behavior and cache control operations 
30 as well as DMA capability. The SmartCache architecture provides predictable behavior and enhanced real-time per- 
formance while keeping high flexibility and ease of use. A detailed description of a SmartCache is provided in US 
Patent Application Serial No. 09/591.537, entitled "Smart Cache" and is incorporated herein by reference. Advanta- 
geously, RAM-set configured as a RAM offers fast memory scratchpad feature. 

[0033] Megacell "outer" memory 112 can be shared between megacell internal processors and external Host proe- 
ms essors or peripherals. RAM usage can also be restricted to the usage of a single processor thanks to the MMU mech- 
anism, described earlier. However, in another embodiment a need might arise in the megacell to add additional physical 
protection per processor on some part of megacell memory to overwrite the MMU intrinsic protection. 
[0034] A unified shared cache architecture of this embodiment is a four way set associative cache with segmented 
lines to reduce system latency. All outer memories are treated as unified instruction/data memory to avoid compiler 
40 restrictions such as data in program space or vice-versa. Size of this cache or the degree of associativity is a design 
choice and may vary in other embodiments of the present invention. General construction of set-associative caches 
are known and need not be described in detail herein. Typically, LI caches are 16kbytes or 32 kbytes, and the L2 
cache is 128kbytes, 256kbytes or larger, for example. Likewise, the number of associated RAM-sets may vary in other 
embodiments. 

45 [0035] RAM-set control registers, such as control register 531 in cache control circuitry 530 (Figure 3A), are memory 
mapped and therefore also benefit from the protection provided by the MMU. However, this would force operations on 
cache or any specific RAM-set to be on separate pages for protection reasons. Therefore, a control register is provided 
in TLB control register set 323 (Figure 3) to configure how and by which CPU the various parts of megacell memory 
are controlled. All CPUs can execute operations such as cache flushing or cache cleaning as these operations will be 

so restricted by a resource identifier field located in the TAG area of the cache. 

[0036] Figure 3A is a block diagram illustrating a representative configurable cache 500 that has a cache represent- 
ative of L2 cache 114 and a RAM-set representative of shared RAM 113. Configurable cache 500 is also representative 
of LI cache 204, 224 that are included respectively in each of the processor modules 1 02, 1 04 of Figure 2. As discussed 
above, the configurable cache is composed of a 4-way set-associative cache that includes a TAG Array 502(0-3) and 

55 Data array 506(2-5) and one or more additional RAM-sets, in this case data arrays 506(0-1 ). In the present embodiment, 
data array 506(1-5) are each 32kbytes, while data array 506(0) is 64kbytes. 

[0037] During an access request, each TAG array 502(0-3) provides a tag value to a respective comparator 546(0-3) 
and is compared against a most significant portion of a proffered address 548. A tag value is stored in tag array 502 
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(0-3) according to an index value that corresponds to a least significant address of a proffered address. Thus, for any 
proffered address, an associated tag nnay be found on anyone of the four tag arrays. If a tag nnatches a proffered 
addresS: then hit/miss logic 510 asserts a respective hit signal hit-way(2-5) 514. In this embodiment, a resource ID 
(R-ID) field 520 and a task ID (task-ID) field 522 is also Included with each entry in the tag array, along with a set of 
5 valid bits VI(1-4). Usage of these fields will be described in more detail later. Prefetch circuitry 516 receives signals 
512-514 and forms a request to L3 memory when a miss occurs. For each hit, the requested date is provided via bus 
541 b to an output port of the cache via cache output buffer 540b. 

[0038] The RAM-set also includes valid bit arrays 504(0-1 ) The RAM-set can be configured as a cache extension or 

as a block of RAM. When configured as RAM, a loading mechanism is provided by a separate DMA engine to optimize 
10 data transfer required by multimedia applications. For each hit in the RAM-set portion of the cache, requested data is 
provided via bus 541a a second output port of the cache via cache output buffer 540a. 

[0039] Cache control circuitry 530 includes control registers 531 which are used to configure the configurable cache. 
Fields In the control register include: RAM_filLmode, Cache_enable, organization, and Full_RAM_base. The control 
circuitry is coupled to all of the operational blocks of the configurable cache and allows for dynamic reconfiguration of 
15 the configurable cache under control of software. 

[0040] In the embodiment of Figure 3A, the RAM-set has two different sized data arrays, Data array 506(0) is 64kbytes 
and Data array 506(1) is 32 kbytes; however, other embodiments may specify all RAM-sets with the same size to 
simplify the hardware logic and the software model. 

[0041] Each RAM-set has an associated TAG register, referred to as Full Set Tag 508(0-1) containing the base 
20 address of the RAM-set and a global valid bit (VG) 509(0-1) in addition to an individual valid bit contained in valid bit 

arrays 504(0-1 ), referred to as VI, for each segment of each segmented line in the associated data array. In the present 

embodiment, RAM-set lines have the same size as the cache lines; however, in other embodiments a longer line size 

can also be used to reduce the number of VI bits. RAM -set base registers are coupled with a logical comparison 542 

(0-1 ) on a most significant address portion 544 for each access request. 
25 [0042] An organization field in cache control register (RAMset-ctrl[n]) 531 for each RAM-set provides the capability 

to configure it as a cache extension (RAM-set) or as a plain RAM. When configured as a plain RAM, the valid bits are 

ignored. Table 1 explains other fields in this register. 



Table 1 - 



Cache Control Register 


Bit[0] 


0 - MPU master. Only the MRU can write to this register 




1 - DSP master. Only the DSP can write to this register 


Bit[1l 


0/1 RAM-set work as a cache or as a RAM 


RAM-set master bit 


each RAM-set can be controlled by one or the other processor write access to the register 
base 



[0043] A status register provides cache information, including number of RAM-sets, sizes, Cache number of way, 
and line size. 

[0044] When configured as a RAM, base address registers 508(0-1) are programmed such that this memory does 
not overlap with other memories in the system. Note, the base address register and the full set tag register are the 
same. This memory space is mapped as non-cacheable at the outer level. RAM control logic (address decode) gen- 
erates a hit equivalent signal, which prevents the outer cache from fetching the missing data/instruction to the external 
memory VG bit 509(0-1) acts as an enable/disable. It is set when the base address register is written to and cleared 
when the RAM is invalidated or disabled. 

[0045] If the register base address of the RAM is programmed in such a way that the associated memory area 
overlays with the external memory, coherency is not guaranteed by hardware of this embodiment. 
[0046] When configured as a cache, hit/miss control circuitry 510 generates hit/miss signals called hit-hit 512 and 
hit-miss 51 3 for each RAM-set. A hit-hit is generated when a valid entry of the RAM-set matches the address provided 
by the core. An entry is valid when both VG and its VI are set. A hit-miss signal is generated when the base address 
of the RAM is valid (VG = 1) and matches the most significant portion of an address provided by a processor but the 
selected entry in the RAM-set has its VI equal to zero. 

[0047] The hit-miss or hit-hit signal has precedence over the hit way (2-5) signals 524 of the 4-way set-associative 
cache. This implies that any value loaded previously In the cache that should be in the RAM-set is never selected and 
will eventually be removed from the cache. However, data can create coherency problem in case of modified data 
(copy back). Therefore, it is recommended to write back ("clean") or even flush the range of address that will correspond 
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to the RAM-SGt range of addresses. 

[0048] Figure 3B is a flow chart illustrating operation of the hit/miss logic of the configurable cache of Figure 3A. In 
step 550, an address is received fronn the processor core in connection with a read operation. If the instruction cache 
is disabled, which is checked in step 552, the instruction Is retrieved from second level memory in step 554. If the 

5 cache is enabled, then if either the high order bits of the address from the processor (ADDR[H}) do not match the high 
order bits of the starting address 508(n) or the global valid bit 509(n) is set to "0" (step 556), then there is a RAM-set 
miss. In this case, if there is a cache hit in the 4-way set associative cache in step 558, then the information is retrieved 
from the 4-way set associative cache is presented to the core processor via cache output buffer 540b. If there is a miss 
in the 4-way set associative cache, the line is loaded into the 4-way cache from second level memory. 

10 [0049] Returning again to step 556, if both the high order bits of the address from the processor (ADDR[H]) match 
the high order bits of the starting address 508{n) and the global valid bit 509{n) is set to "1", then there is a RAM-set 
hit at the line corresponding to ADDR[L], and the valid entry bits are used to determine whether it is a hit-hit situation 
where the requested instruction is present in the RAM-set and can be presentedto the processor, or a hit-miss situation 
where the requested instruction is mapped to the RAM-set, but the information needs to be loaded into the RAM-set's 

15 data array 506(n) from the second level memory. If, in step 564, the individual valid entry bit (VI) 504(n) for the line 
indicates that the line is valid (VI[ADDR[L]]=1), the instruction is present in the RAM-set and is presented to the proc- 
essor through the RAM-set's output buffer 540a. If, on the other hand, the valid entry bit for the line indicates that the 
line is not valid (VI[ADDR[L]]=0), the line is loaded into the data array 506(n) of the RAM-set from main memory in step 
568. 

20 

Cache Features 

[0050] The unified cache memory of the present embodiment supports write back, and write through with/without 
write-allocate on a page basis. These controls are part of the MMU attributes. Hit under miss Is supported to reduce 

^5 conflicts between requesters and consequent latency. Concurrent accesses on RAM-sets and cache are supported. 
[0051] Referring again to Figure 3A, on a cache miss, the segment corresponding to the miss is fetched from external 
memory first. For this discussion, data array 506(0) will be discussed, although it Is actually configured as a RAM-set 
instead of Cache. All of the data arrays 506(0-5) have the same organization. Each data array has a number of lines, 
line 507 being representative, which are segmented into four segments 507(0-3) that each hold 16 bytes data or in- 

30 struction. For example, in L1 cache 224 if a miss occurs in second segment 507(1), the second segment is fetched 
from second level RAM 113 or cache 114 or from third level memory 132, 134 if the second level misses. Then, the 
third segment and finally the fourth segment are loaded into segments 507(2) and 507(3) automatically, referred to as 
automatic hardware prefetch. In this embodiment, first segment 507(0) is not loaded into the cache. This sequence of 
loads can be interrupted on a segment boundary by a miss caused by a request having higher priority. The Interrupted 

35 load Is not resumed, as the remaining segments will be loaded if required later in response to a new miss. 

[0052] Likewise, second level cache 114 has a data array with a number of lines that are segmented into four seg- 
ments that each hold 1 6 bytes. If second level cache 114 misses, it will be filled from third level memory 132, 134 using 
a multi-cycle operation In which each segment of a given line Is accessed. Multi-cycle operations on second level cache 
1 14 are non-blocking. A Multi-cycle cache operation is launched and a status bit indicates its completion. As operations 

40 can be initiated by several requesters, such as DSP 104 and MRU 102, these operations can not be blocking due to 
real time constraints. If one processor initiates a clean_all_task_ID or a block operation for example, other requests 
can interleave. 

[0053] Each cache segment has a valid bit (VI) and a dirty bit (not shown) in tag array 502(0-3). Each line such as 
507 also has an associated shared bit (not shown) in the tag array. On a write back when a line is replaced, only the 

45 segments with modified (dirty) data are wrinen back. Each RAM-set segment has a valid bit (VI) in tag array 504(0-1). 
[0054] In this embodiment, RAM-sets do not have Task_ID and R-ID fields and shared bit markers associated with 
each line. Operations on lask_ID, R-ID, data marked as shared are limited to the cache. However, another embodiment 
may harmonize the RAM-set and cache. The hit logic of second level cache 114 only uses the address field. Task-Id 
and R-ld are used in task operations only. 

50 [0055] In this embodiment, L1 caches 202, 206, 222, 226 and l_2 cache 114 are organized as 4-way set associative 
caches. A random cache replacement strategy has been chosen for the replacement algorithm of the 4-way set asso- 
ciative caches. In this embodiment, the caches do not support cache entry locking except through the RAM -set. 
[0056] Table 2 Includes a listing of the various cache and RAM control operations that can be invoked by the proc- 
essors in the megacell of the present embodiment. In this embodiment, all operations on an entry operate on segments, 

55 and there are four segment per entry, as discussed above. 

[0057] A state machine in cache controller circuitry 530 executes a requested control operation, as indicated by a 
control word. 

[0058] In another embodiment, the control operations can be invoked by executing an instruction that invokes a 
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hardware or software trap response. As part of this trap response, a sequence of instructions can be executed or a 
control word can be written to selected address, for example. In another embodiment, one of the processors may 
include instruction decoding and an intemal state machine{s) to perfomi a TLB or Cache control operation In response 
to executing certain instructions which may include parameters to specify the requested operation. 

Table 2 - 





Cache and RAM Control Operations (C: operation on the cache, RS: operation on RAM-set, R operation on RAM) 




Function 




Software view (memory mapped/ co-proc) 


10 


PliicK ontrv/ /£^H^I^^iCC^ 
rlUoll ciluy ^ctUUIcfooy 


C / R S 


Flush the entry^ , whose address matches the provided 
address or a Range of addresses, If End has been set 
previously. Flush-range instruction is made of two 
consecutive Instructions Set_End_addr(address) + 
Flush_entry (address). 


15 


Flush_alLentry_of_task_ID(taskJD) 


C 


Flush all entries matching to the current taskID in the 
cache but not In the RAM-set 




riusn_an_eniry_oi_ ri_iLHias»v_iL/^ 




Flii'^h all pntripc; matchinn to the current R ID In the 
cache but not in the RAM-set 


20 


Cli 1 o h> nil 




FiiiQh all pntrip*? in thp farhe but not in RAM-set 




Flush_alLshared 


C 


Flush all entries marked as shared 


25 


Flush_alLtask_ID_ shared(task_ID) 


c 


Flush all entries matching the current taskID and 

markprt flc QharprI 

iMdi^C^U do oilCllCU 


riusn_aii_iasK__iij_n oi__snarea ^iasK_iLj; 




Pliich all pntrioc matr^hinn thP f*iirrpnt ta^klD flnd 

niUoil ull ClIllICO 1 1 Idllk^l ill 1^ 11 lurUllClll tClOiV 1 1— ' al tu 

marked as not shared 


30 


Clean_entry (address) 




PIpan thp pntrv/'' whocio aHrlrpc;*^ matphp*^ thP Dfovidod 

\^ Iwdl 1 LI ft* W 1 Illy f W 1 1 L/O W Cl\.J\.J 1 C.OO \ 1 ICti^l LI 

address or a Range of address if End has been set 
previously. Clean-range instruction is made of two 
consecutive instructions Set_End_addr( address) + 
Clean_entry (address). 


35 


Clean_all_entry_of_ tasklD(task_ID) 


C 


Clean all entries matching to the current taskID in the 

cache but not in the RAM-set 




oiean_au_eniry_0T_ M_iLHTasK_iu; 


w 


Plpan all ontripQ matohinn to thP r^iirrpnt R ID in the 
wicdM dii ciiLiico iiiaiwiiiii^ LU 11 ic ^uiiwiii 1 i_ii.^ Hi 11 ic 

cache but not in the RAM-set 




uiean_aM 


c 


r^loan all antripc in thiP r^anhp htiit not in RAM-set 


40 


Clean_alLshared 


C 


Clean entries marked as shared 




FIush_alLtaskJD_ shared(task_ID) 


c 


Flush all entries matching the current taskID and 
marked as shared 


45 


Clean_alLtasklD_no t_shared(Task_ID) 


c 


Clean all entries matching the current taskID and 

marked as not shared 


50 


Clean&Flush_single_ entry (address) 


C/R S 


Clean and flush the entry whose address matches 
the provided address or a Range of address if End has 
been set previously. Clean-range instruction is made 
of two consecutive instructions Set_End_addr 
(address) + Clean_entry (address). 




Clean&f lush_alL entry_of_tasklD (Task_ID) 


c 


Clean and flush all entries matching to the current 
taskID in the cache but not in the RAM-set 


55 


Clean&flush_all_ent ry_of_R_ID (Task_ID) 


C 


Clean and flush alt entries matching to the current R_ID 
in the cache but not in the RAM-set 




Clean&flush_all 


C 


Clean and flush all entries in the cache but not in RAM- 
set 
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Table 2 - (continued) 



Cache and RAM Control Operations (C: operation on the cache, RS: operation on RAM-set, R: operation on RAM) 


Function 




Software view (memory mapped/ co-proc) 


Clean&flush_all_ shared 


C 


Clean and flush entries marked as shared 


Clean&flush_alL tasklD_shared (taskJD) 


C 


Clean and flush all entries matching the current tasklD 
and marked as shared 


Clean&flush_alL tasklD_not_shared {task_ID) 


C 


Clean and flush all entries matching the current tasktD 
and marked as not shared 


Sel_RAM_Set_Base_ addr (RAM-setID) 


R S/ R 


Set new RAM-sel base address, set VG and clear all 
VI and set End to last RAM-set address by default 
preparing the full RAM-set loading. In that case no 
need to write the END address before writing the start 
address to load the RAM-set 


Set_End_Addr (address) 


C/RS 


Set end address of the next block load and set the 
RAM'Set controller in block fill mode. 


Set_start_addr (address) 


C/RS 


Set start address of a block and initiates the loading of 
this block 


Flush_RAM-set (RAM-set_ID) 


RS/R 


Clear VG and all VI of the selected RAM-sel 


Function 




Software view (memory mapped/ co-proc) 




/R 





Detailed Aspects 



[0059] Various aspects of the digital system of Figure 1 will now be described in more detail. 

[0060] Figure 4 is a flow diagram of an L2 cache 900 representative of L2 cache 114 in the megacell of Figure 1 , 
illustrating an interruptible prefetch system that provides miss under miss support. As described above, the L2 cache 
architecture of this embodiment is embodied with 4-way associatively, four segments per entry and four valid and dirty 
bits per entry. Backup memory 930 is representative of any L3 memory 132/134. When the L2-cache misses/ the 
penalty to access data within L3 memory 132, 134 is high. The system supports miss under miss to let a second miss 
interrupt the segment prefetch for a first miss. 

[0061] For example, when a processor PI 910 access to its LI cache 912 misses and L2 cache 900 also misses, 
an L2-cache controller accesses backup memory 930 and transfers one or several segments 932 of 16 Bytes from 
memory 930 to a cache line 902, for example, in L2 cache 900. Memory controller 934 generates an address header 
935 to access memory 930 in burst mode and one or several segments 932{n) of 16 Bytes can be transferred for the 
same request. If, for example, an access to a segment 902(2) misses as indicated by miss circuitry 904, then the 
controller associated with miss circuitry 904 fetches segment 932(2) and prefetches segment 932(3) and segment 932 
(4). Segment 932(2) is simultaneously fonwarded to processor PI to satisfy its request. During the miss time, other 
request that hit the L2 cache can be served. Subsequently, If an access from a processor P2 920 misses the L2 cache, 
then the ongoing prefetch sequence for processor P1 is stopped and the P2 miss is served. Therefore, some of the 
segments in line 902 will be valid, such as 902(2-3) for example, and some of them will still be invalid, such as 902 
(1,4) for example if a prefetch sequence is interrupted. 

[0062] In this embodiment of the invention, a later access to line 902 will result in amiss If segment 902(1) is accessed. 
However, since segment 902(2-3) are valid, they will not be prefetched, only segment 902(4) will be prefetched. 
[0063] Thus, an interruptible L2-cache prefetch system with miss under miss support is provided. 
[0064] Figure 5 is a flow chart illustrating operation of the interruptible prefetch system of Figure 4. This is a method 
ot operating a digital system that has a cache with a plurality of lines, with more than one segment per line. In step 
580, a request is made by a requester for a data item. As discussed with reference to Figure 1 and Figure 2, this 
request may come from any of several resources that are connected to traffic controller 110. 

[0065] In step 582, detection circuitry in the cache determines if the requested data is present in the cache. If the 
data is present, the request is serviced by returning the requested data to the requester in step 584. If not. a miss occurs. 
[0066] In step 586, a segment is fetched from memory that contains the requested data item. As discussed earlier, 
each line of the cache of the present embodiment contains four segments, and each segment contains sixteen bytes. 
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Generally, the requested data item will be four bytes or less. After the segment is fetched, the request is serviced by 

providing the requested data to the requester. 

[0067] In step 588, other segments for the same line are prefetched. Steps 586 and 588 are actually performed in 
a single operation by sending one request to memory controller 934, as discussed with reference to Figure 4. While 
5 the prefetch continues, other requests are received and processed by the cache. If the requested data is within the 
just fetched segment or In segments that have been successfully prefetched or in other valid lines of the cache, then 
the cache services the request and the prefetch continues. 

[0068] If a miss occurs prior to completing the prefetch of step 588, as indicated in step 589, then a decision is made. 

If the miss has a lower priority than the active prefetch operation, then the miss is queued and the prefetch continues, 
10 as will be described in more detail with respect to Figure SB; however, if the miss has a higher priority than the active 

prefetch operation, then the prefetch operation is hailed in step 590 and a new fetch/prefetch operation is started by 

repeating steps 586/588. In step 589, priority of a request is determined based on the priority of the requesting hardware 

device and the priority of the software task on that device, as will be discussed in more detail with reference to Figure 9. 

[0069] After completion of a prefetch operation in step 588, a check is made in step 592 to determine if there are is 
15 a pending prefetch that was halted by step 590. If so, it is resumed by returning to step 588. In another embodiment, 

if a prefetch is halted in step 590, then it is cancelled. In this case, step 592 is not performed. 

[0070] While this description has been oriented to L2 cache 114, It can also apply to LI caches 202, 206, 222, and 
226, for example. 

[0071] Figure 6A is a timing diagram of the inlerruptible prefetch system illustrating a low priority prefetch being 
20 halted in favor of a higher priority miss. In this diagram, an L1 miss results in a request to L2 cache 114. The LI miss 
can be from any of the L1 caches 202, 206, 222, and 226 or from other devices connected to traffic controller 110. 
Note that a four segment fetch/prefetch sequence is illustrated. However, as discussed earlier, if the miss occurs in 
the middle of a line, preceding segments are not prefetched. However, in another embodiment, preceding segments 
could be prefetched. Similarly, in another embodiment, there may be a different number of segments on each line of 
25 the cache. 

[0072] An LI miss 600 occurs and results in a request 602 to the L2 cache If the L2 cache misses, then a fetch/ 
prefetch request is made to L3 memory, as discussed with respect to Figure 4. Latency 604 occurs while the L3 memory 
request is being processed. A first segment 605(1 ) Is then returned to the L2 cache, followed in sequence by segments 
605(2) and 605(3). However, a higher priority request 612 is received in response to an L1 miss 610 while the prefetch 

30 is in operation. Because it has a higher priority than request 602, the prefetch is halted and request 612 is processed. 
After latency 614, segment 615(1) is received from L3 memory, followed in sequence by segments 615(2-4). 
[0073] Figure 6B is a timing diagram of the interruptible prefetch system illustrating a higher priority prefetch not 
being halted in favor of a lower priority miss, in this case, an L1 miss 620 occurs and results in a request 622 to the 
L2 cache. If the L2 cache misses, then a tetch/prefetch request is made to L3 memory. Latency 624 occurs while the 

35 L3 memory request is being processed. A first segment 625(1 ) is then returned to the L2 cache, followed in sequence 
by segments 625(2-4). During the prefetch of segments 625(2-4), a lower priority request 632 is received in response 
to an L1 miss 630. However, because it has a lower priority than request 622, the prefetch is not halted and the prefetch 
of segments 625(2-4) is completed. Then request 612 is processed. After latency 634, segment 615(1) is received 
from L3 memory, followed in sequence by segments 615(2-4). Latency 634 is longer than latency 614. 

40 [0074] Figure 7 is a flow diagram for an L2 configurable cache 1000 that illustrates concurrent access of L2 cache 
1014 and L2 RAM-set 1013, which is representative of configurable cache 112 of megacell 100. The shared L2-Con- 
figurable cache's RAM-sets 1013 and Cache sets 1014 can be accessed concurrently. When different processors, 
such as processors 1002, 1004 for example, request an access to memory space stored in different memory blocks, 
the configurable cache 1000 services accesses in parallel. 

45 [0075] For example, processor 1 002 has request 1022 pending due to a miss in It's LI Instruction cache, processor 
1 004 has data request 1 021 pending for a data request, and processor 1004 has request 1020 pending due to a miss 
in it's L1 instruction cache. Multiple buses connect processors 1002, 1004 and configurable cache 1000 and are con- 
trolled by traffic controller 1010. 

[0076] Parallel decoding is done by RAM-sets 1013 to detemnine which pending accesses are within the address 
50 range of the RAM-set. Requests that fall within the RAM-set are excluded from cache 1 01 4. Thus, accesses not located 
in RAf^-sets 1013 are reordered and queued for cache 1014. RAM-set 1013 and cache 1014 then make concurrent 
accesses for the pending requests. If a concurrent access is not possible because the two memory spaces correspond- 
ing to the requests are in the same memory block, then the request are served sequentially. 

[0077] Figure 8A illustrates a request queue for the L-2 memory system of Figure 7. The system contains a request 
55 queue 1 1 00 that stores the waiting access request from different processors. Conceptually, two queues 11 00a, 1 1 00b 
are formed with a duplicate list of pending requests. Parallel decoding is then done by RAM-sets 1013 (see Figure 7) 
to determine which pending accesses are within the address range of the RAM-set. Requests that fall wrthin the RAM- 
set are excluded from cache 1014. In this example, requests R1 and R3 fall within the RAM-set, therefore they remain 
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in RAM-set queue 1100b and are excluded from cache queue 1100a. Requests R2, R4, and R5 are not located in 
RAM-sets 101 3 and are therefore are excluded from RAM-set queue 1100b. The non-excluded requests in each queue 
are reordered and queued for access. RAM-sel 1 013 and cache 1 014 then make concurrent accesses for the pending 
requests as illustrated in time slots 1102a-c. If a concurrent access is not possible because the two memory spaces 

5 corresponding to the requests are in the same memory block, then the request are served sequentially. 

[0078] Figure 8B is a more detailed block diagram of the L2 memory system of Figure 3A, illustrating the request 
queue circuitry. A set of pending requests Rl-Rn 1100 is compared in parallel to base register 508 using a set of 
comparators 542. Hit circuitry 510 asserts corresponding hit_RS signals 1104 if global valid bit 509 is asserted for each 
pending request that matches tag register 508. Arbitration circuitry 1112 within management circuitry 1110 receives 

10 hit_RS signals 1104 and selects one Ry from among those that are asserted. Multiplexor 1114 is responsive to arbi- 
tration circuitry 1112 and selects corresponding request address Ry from pending requests R1-Rn and applies this 
selected request address to RAM-set data array 506. Thus, the set of asserted Hit_RS signals 1104 correspond to 
RAM-set queue 1100b as illustrated in Figure 8A. If the associated individual valid bit VI 504 is set, hit-hit signal 512 
is asserted and a requested data/instruction value is returned to the requester. If the associated individual valid bit is 

^5 not set, then a hit-miss condition occurs, as discussed earlier, and a wait indication WAIT 1 is asserted by wait circuitry 
1130 While a RAM-set fill Is performed. When valid data is in data array 506(0), it is provided to a requesting device 
via data bus 541a that is connected via a cache output port to traffic block 110. 

[0079] Concurrently, arbitration circuitry 1116 within management circuitry 1110 receives cache request signals 1101 
and selects one Rx from among those that are asserted. Multiplexor 1118 is responsive to arbitration circuitry 1116 and 
20 selects corresponding request address Rx from pending requests 1 1 00a and applies this selected request address to 
cache tag array 502(n). Each cache request signal 1101 is asserted only if a request Rl-Rn Is asserted and a corre- 
sponding hit_RS signal 1104 is not asserted, in response to mask circuitry 1106a-n. Thus, the set of asserted cache 
request signals 1101 correspond to cache queue 1100a as illustrated in Figure BA. If one of miss-way signals 514 is 
not asserted, then a hit has occurred and the requested data/instruction is returned to the requester. If all four miss- 
es way signals are asserted, then a miss condition occurs, as discussed earlier, and a wait indication is asserted by wait 
circuitry 1132 while a cache fill is performed under control of prefetch circuitry 516. When valid data is in data array 
506(n), it is provided to a requesting device via data bus 541 b that is connected via another cache output port to traffic 
block 110. 

[0080] Advantageously, data bus 541a and data bus 541b can provide requested data to two different requesters 
30 concurrently via two separate cache output ports and parallel busing within traffic block 110. 

[0081 ] An aspect of the present embodiment is that during the loading of the L2 cache, which takes potentially several 
tens of cycles, the arbitrator 1116 may let other CPUs access the L2 cache. If they hit, they can continue without being 
impacted by the miss caused by a prior CPU request. If they miss but have a lower priority they wait until completion 
of the current prefetch transfer. If a request misses and has a higher priority, that request interrupts the current transfer 
35 on a segment boundary and is served next, depending on the state of the memory controller 

[0082] For example, single port dynamic access RAM (SDRAM) memory 134 has a controller that provides informa- 
tion such as active row, as described in US patent application serial NO. 09/170,834, MEMORY CONTROL USING 
MEMORY STATE INFORMATION FOR REDUCING ACCESS LATENCY If the higher priority request Is for an SDRAM 
active row, then it might be worth Interrupting the previous burst. Otherwise, it might be preferable to complete the 
"fo current transfer to avoid unnecessary pre-charge operation on the SDRAM. Memory state signals 1120 received from 
memory controller 934 provide state information to management circuitry 1110 that is used to determine if an active 
prefetch operation should be preempted and halted by a pending request. 

[0083] Figure 8C is a flow chart illustrating operation of simultaneous multiprocessor accesses to the L2 cache of 
Figure 3A using the queues and arbitration circuitry discussed with reference to Figure 8A and Figure 8B. . 

45 [0084] In step 1140, multiple requests for access to the cache are received from the plurality of request ports. As 
discussed earlier, the cache has a number of request ports that receive requests from the DSP 1 04, MPU 102, system 
host 120 and the other application specific processors 108, if present. Furthermore, DSP 104 can post a request for 
a miss in L1 data cache 202 simultaneously with posting a request for a miss in LI instruction cache 206. Likewise, 
MPU 102 can post a request for a miss in L1 data cache 222 simultaneously with posting a request for a miss in LI 

50 instruction cache 226. 

[0085] In step 1142, all of the requests received on a given cycle are sorted according to which portion of the cache 
will service them. As discussed with reference to Figure 8B, detection circuitry including comparators 542 and hit 
circuitry 51 0 determine which of the requests fall within the portion 506(0) of the cache subsystem. The requests that 
correspond to the portion 506(0) are then blocked from cache portion 506(n) by masking circuitry 1106. 
55 [0086] Steps 1144a and 1144b are performed on the sorted results of step 1142. Step 1144a represents cache 
requests that are sorted for one portion of the cache, while step 1144b represents cache requests that are sorted for 
a different portion of the cache. In each of these steps, the requests are sorted according to priority information that is 
provided along with each request to form a queue of requests. Such priority information will be described with reference 
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to Figure 9. 

[0087] In steps 1146a and 1146b. the highest priority request is taken from each queue formed by steps 1144a,b 
and a cache hit determination is made using the detection circuitry of each portion of the cache. Advantageously, steps 
1146a and 1146b are performed concurrently using the separate detection circuitry in each portion of the cache. 
5 [0088] In steps 1 148a,b, a fetch is made to acquire data if the corresponding hit decision from steps 11 46a,b indicates 
a miss. If a miss occurs in either of steps 1146a,b, then additional time is required to perform the fetch to L3 memory. 
In the present embodiment, the same prefetch circuitry 516 is used to control the prefetch; therefore if both of steps 
1148a, b are performed, they are performed in sequence. 

[0089] In steps 1 1 50a,b, the requested data is provided to each requester, after being prefetched if needed. However, 
10 if both steps 1146a and 1146b determine a hit status for both requests, then no fetch is needed and steps 1150a and 
1150b are performed concurrently using parallel data buses in traffic control block 110. 

[0090] In the present embodiment, the cache is configurable to have two different portions, such that two different 
queues are formed in step 1142. In another embodiment, a cache may be partitioned into more than two portions and 

therefore more than two queues would be formed. Likewise, in another embodiment, more than two parallel data buses 
15 in traffic block 110 may service more than two requests from the same cache concurrently. In another embodiment, 
additional prefetch circuitry can be provided to allow concurrent prefetch operations. 

[0091] Figure 9 is a block diagram illustrating a priority register in each processor of a megacell similar to that of 
Figure 1 for task based priority arbitration. Typically: each software task Includes a task priority value that is commonly 
used by an operating system to schedule an order of execution for a set of pending tasks 1440. In this illustration, a 

20 circle such as 1442 represents a task, with a task name "c" and a task priority of 12, for example. Likewise, task 1443 
has a task name "r" and a priority of 15, where a lower number indicates a higher priority. If the set of tasks 1440 are 
assigned to three processors, then an operating system on each processor forms a ready to execute queue, such as 
ready queue 1 446 in which task "c" is scheduled for first execution, then task "a" and finally task "b" according to priority 
values of 1 2, 15, and 50 respectively. In a prior system, access to shared resources 1432 would be based on an access 

25 priority associated with the processor on which a task is executed. Unfortunately, this scheme may result in slow 
execution of a high priority task on a low priority processor. 

[0092] Three processors 1400, 1402, 1404 are illustrated; however, the concept is applicable to only two processors 
or to four our more. A priority register 1410 Is associated with a task_ID register 1412 in processor 1400. Each of the 
other processors is similarly equipped. A priority field value from priority register 141 0 is exported to traffic control logic 
30 1 430 that prioritizes access to shared resources 1 432, that can be L2 cache, for example, or other memory or interface 
devices, for example. 

[0093] One bit 1410a of register 1410 is responsive to Interrupt signal 1414 such that whenever 1400 perfomris a 
context switch in response to an interrupt, bit 1410a Is set to a value to indicate an interrupt service routine (ISR) Is 
being executed. 

35 [0094] In a first embodiment with a simple solution, portion 1410b of register 1410 is only one bit, such that register 
1410 is a 1+1 bit register (2-bits). As discussed above, bit 1410a is set by the hardware when an interrupt (or an 
exception) occurs. An application program being executed by processor 1400 can configure portion 1410b and will 
provide one value to the bit if the application must execute with a defined maximum real time, referred to as "hard real 
time" (HRT). On the other hand, an application that does not have a hard time limit will provide another value to the 

40 bit to indicate "soft real time" (SRT). An operating system on processor 1400 can control both bits. Thus, 2-bit priority 
code is formed as described in Table 3. In the case of an interrupt, the contents of priority register 1410 are saved prior 
to taking an ISR context switch. 





Table 3 






1+1 Bit Priority 


Type of task 


priority 


Set by 


code 


Interrupt service routine 


highest 


Interrupt hardware 


00 


Kernal OS task 




Kernal software 


01 


Hard real time task 




Application software 


10 


Soft real time task 


lowest 


default 


11 



[0095] In an alternative embodiment, priority register portion 1410b is n bits, where n is generally 8-bits. One bit 
1410a of register 1410 Is responsive to interrupt signal 1414 such that whenever 1400 performs a context switch in 
response to an Interrupt, bit 1410a is set to a value to Indicate an interrupt service routine (ISR) is being executed. Bit 
1 41 Oa is treated as a most significant bit of priority register 1410, thus 1 +n bits are provided for the OS priority field by 
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priority register 1410. In this embodiment, a task priority associated with each task is loaded in priority register portion 
1410b as each task begins execution. 

[0096] In either embodiment, the 2 bits or n+1 bits are used to control the priority of accesses to shared resources 
1432- In addition, each resource is also assigned a priority. If two resource make a requests with identical task priority 
5 to a shared resource, then access to the shared resource is provided in a round robin manner so that the higher priority 
resource doesn't starve the lower priority resource. 

[0097J In an alternative embodiment, two fields are used to detemnine the access priority to the shared resources. 
One field comes from the processor and carries the priority associated with the current task and the second field comes 
from an MMU TLB that contains the priority of a given MMU page. The highest value is used for priority arbitration. 

10 

Digital System Embodiment 

[0098] Figure 10A illustrates an exemplary implementation of an example of such an integrated circuit in a mobile 
telecommunications device, such as a mobile telephone with integrated keyboard 12 and display 14. As shown in 
'5 Figure 10, the digital system 10 with a megacell according to Figure 2 is connected to the keyboard 12, where appro- 
priate via a keyboard adapter (not shown), to the display 14, where appropriate via a display adapter (not shown) and 
to radio frequency (RF) circuitry 16. The RF circuitry 16 is connected to an aerial 18. 

[0099] It Is contemplated, of course, that many other types of communications systems and computer systems may 
also benefit from the present invention, particulariy those relying on battery power. Examples of such other computer 
20 systems include personal digital assistants (PDAs) portable computers, smart phones, web phones, and the like. As 
power dissipation is also of concern in desktop and line-powered computer systems and micro-controller application, 
particularly from a reliability standpoint, it is also contemplated that the present invention may also provide benefits to 
such line-powered systems. 

[0100] Fabrication of the digital systems disclosed herein involves multiple steps of implanting various amounts of 
25 impurities into a semiconductor substrate and diffusing the impurities to selected depths within the substrate to form 
transistor devices. Masks are formed to control the placement of the impurities. Multiple layers of conductive material 
and insulative material are deposited and etched to interconnect the various devices. These steps are performed in a 

clean room environment 

[0101 J A significant portion of the cost of producing the data processing device Involves testing. While In wafer form, 
30 individual devices are biased to an operational state and probe tested for basic operational functionality. The wafer is 
then separated into individual dice which may be sold as bare die or packaged. After packaging, finished parts are 
biased into an operational state and tested for operational functionality. 

[0102] The digital systems disclosed herein contain hardware extensions for advanced debugging features. These 
assist in the development of an application system. Since these capabilities are part of the megacell itself, they are 
35 available utilizing only a JTAG Interface with extended operating mode extensions. They provide simple, inexpensive, 
and speed independent access to the core for sophisticated debugging and economical system development, without 
requiring the costly cabling and access to processor pins required by traditional emulator systems or intruding on 
system resources. 

[0103] As used herein, the terms "applied," "connected," and "connection" mean electrically connected, including 
40 where additional elements may be In the electrical connection path. "Associated" means a controlling relationship, 
such as a memory resource that Is controlled by an associated port. The tenns assert, assertion, de-assert, de-asser- 
tion, negate and negation are used to avoid confusion when dealing with a mixture of active high and active low signals. 
Assert and assertion are used to indicate that a signal is rendered active, or logically true. De-assert, de-assertion, 
negate, and negation are used to indicate that a signal is rendered inactive: or logrcalty false. 
45 [0104] While the invention has been described with reference to illustrative embodiments, this description is not 
intended to be construed in a limiting sense. Various other embodiments of the invention will be apparent to persons 
skilled In the art upon reference to this description. For example, in another embodiment, the L2 cache may be a simple 
cache that does not include RAM-set or configurable features while stilt providing two or more concurrent access ports 
using concurrent detection circuitry. The cache may be positioned at a level other than l_2. The cache may have a 
50 different set organization with a different number of segments per line, for example. The cache may have more than 
two detection circuits and output ports so that three or more requests can be serviced concurrently. 



55 



Claims 

1 . A method of operating a digital system having a cache connected to a plurality of request ports, the method com- 
prising the steps of: 
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receiving a plurality of requests for access to the cache from the plurality of request ports; 

concurrently evaluating at least two requests from the plurality of requests to determine hit/miss status; and 

concurrently serving at least two requests from the plurality of requests that hit in the cache. 

5 2. The method of Claim 1 , wherein the cache is configured as at least two portions and wherein the step of concurrently 
serving comprises: 

serving a first request hit of the plurality of requests from a first portion of the cache; and 

concurrently serving a second request hit of the plurality of requests from a second portion of the cache. 

10 

3. The method according to either of Claims 1 or 2, further comprising the step of sorting the plurality of requests into 
separate queues each associated with a different portion of the cache. 

4. The method according to Claim 3, further comprising the step of sorting the requests in each queue according to 
t5 a priority of each request in the queue. 

5. The method according to any of Claims 1 - 4, further comprising the steps of: 

assigning a first range of addresses lo a first portion of the cache; and 
20 blocking any address from the first range of addresses from being cached in a second portion of the cache. 

6. A digital system having a cache, wherein the cache comprises: 

a plurality of sets which each have a plurality of lines for holding data and an associated tag to indicate if data 
25 stored in each line is valid; 

first detection circuitry operable to detect if a first requested data is present in the cache by examining a fist 

set of tags; and 

second detection circuitry operable to detect it a second requested data is present In the cache by examining 
a second set of tags, wherein the first detection circuitry and the second detection circuitry operate concurrently. 

30 

7. The digital system according to Claim 6, further comprising blocking circuitry connected between the first detection 
circuitry and the second detection circuitry, the blocking circuitry operable to block a first request from being pre- 
sented to the second detection circuitry if the first request corresponds to the first set of tags. 

35 8. The digital system according to either of Claim 6-7, wherein the first set of tags Is associated with a first portion of 
the cache and the second set of tags is associated with a second portion of the cache. 

9. The digital system according to Claim 8. wherein the first set of tags has a first number of valid bits per line and 
the second set of tags has a different number of valid bits per line. 

40 

10. The digital system according to any of Claims 8-9, wherein the first portion of the cache has a single tag per set 
and the second portion of the cache has a plurality of tags per set. 

11. The digital system according to any of Claims 8-10, wherein the first portion of the cache has a first number of 
45 lines and the second portion of the cache has a different number of lines. 

12. The digital system according to any of Claims 6-11 being a cellular telephone, further comprising: 

a processor (CPU) connected to the cache; 
50 an Integrated keyboard connected to the CPU via a keyboard adapter; 

a display connected to the CPU via a display adapter; 
radio frequency (RF) circuitry connected to the CPU; and 
an aerial connected to the RF circuitry. 
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FIG. 2A 
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